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(54) Microscopy 



(57) A method of telemicroscopy comprises the step 
of preparing a specimen on a microscopy slide. The 
slide is placed upon the stage of a microscope equipped 
with digital imaging apparatus and motorised stage and 
the specimen imaged to obtain a composite high reso- 
lution image of the whole specimen. A relatively low res- 
olution copy of that image is obtained and stored in a 



datastore. The method further comprises the steps of 
allowing access to the datastore from a terminal trans- 
ferring the low resolution image to the terminal and dis- 
playing the image upon a monitor selecting by means 
of the remote terminal, as desired, an area of the low 
resolution image and transferring corresponding high 
resolution image data for that area from the datastore 
to the terminal. 
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(54) Microscopy 

(57) A method of telemicroscopy comprises the step 
of preparing a specimen on a microscopy slide. The 
slide is placed upon the stage of a microscope equipped 
with digital imaging apparatus and motorised stage and 
the specimen imaged to obtain a composite high reso- 
lution image of the whole specimen. A relatively low res- 
olution copy of that image is obtained and stored in a 



datastore. The method further comprises the steps of 
allowing access to the datastore from a terminal trans- 
ferring the low resolution image to the terminal and dis- 
playing the image upon a monitor selecting by means 
of the remote terminal, as desired, an area of the low 
resolution image and transferring corresponding high 
resolution image data for that area from the datastore 
to the terminal. 
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Description 

[0001] The present invention relates to telemicrosco- 
py and microscopy training. 

[0002] Telemedicine : by which a range of data, such 
as x-rays or ECG traces, relating to a patient is trans- 
mitted from one location to another for diagnosis or a 
second opinion, is the focus of much attention because 
of its potential to improve the quality of healthcare while 
reducing costs. There have been many attempts at de- 
veloping telemedical applications involving the use of 
microscopes, such as telepathology and telecytoiogy. 
All involve the capture of digital or analogue images from 
a microscope and transmission of these images to a re- 
mote site for the purpose of a second opinion or remote 
diagnosis. However, as will be described, none of the 
existing systems has been entirely satisfactory. 
[0003] A fundamental problem in the field of telemi- 
croscopy is that the field of view of the microscope is 
tiny in relation to the size of the specimen on the micro- 
scope slide. By way of example, a typical cytology 
'smear' will occupy an area of at least 20mm by 50mm, 
that is 1000mm 2 . The field of view of a typical 20x mag- 
nification objective lens is only about 0.4mm by 0.4mm, 
or 0.16mm 2 . The entire image can therefore be consid- 
ered to be formed by over 6000 distinct fields. A remote 
consultant will not want to make a diagnosis on the basis 
of just a few images selected by another worker, he will 
want to have access to the whole of the slide and to be 
able to change or have changed the magnification as 
and where he wishes. 

[0004] The simplest solution to this problem is a pro- 
cedure known as static tele-microscopy. In its very basic 
form, alt that is required is a camera coupled to the mi- 
croscope, some basic software, a network connection 
such as via the Internet to a remote display, and means 
for voice communication between the two locations. The 
microscope is operated by a local worker who will typi- 
cally, based on their own knowledge, select an initial ar- 
ea for review by the remote consultant. An image of that 
area will be acquired and transmitted to the remote con- 
sultant's monitor. Based upon what he can see, he re- 
lays instructions over the telephone to the local worker 
- left, right, up, down, increase magnification, etc. Fur- 
ther images are acquired and relayed to the consultant 
until he is satisfied that he has sufficient information up- 
on which to base his diagnosis. Such static telepathol- 
ogy systems have the virtue of simplicity and low cost. 
However, trials have repeatedly confirmed that it is un- 
satisfactory in practice to rely upon a few fixed images 
and few consultants will be prepared to offer an opinion 
or make a diagnosis on this basis. 
[0005] An improved system is known as dynamic te- 
lemicroscopy. Essentially, once the slide has been pre- 
pared locally, the microscope itself is operated remotely 
by the remote consultant. Examples are shown in US- 
A-5 216 596 and US-A-5 297 034. An example has also 
been placed on public access via the Internet by the De- 



partment of Pathology at the Charite Hospital in Berlin 
(http://amba.charite.de/telemic/index. html.). However, 
such on-line systems are expensive both in terms of 
buying the equipment and in terms of the consultant's 
5 time. These systems also n eed high bandwidth telecom- 
munications, typically at least 384 kbits/sec for even on- 
ly moderately satisfactory use. Whilst the consultant has 
full control over the microscope, there are delays whilst 
instructions are relayed to the microscope, the micro- 
10 scope is adjusted in accordance with those instructions, 
and the new image is obtained and relayed to the con- 
sultant. Such systems cannot strictly be considered to 
operate in real-time. For a comparison, whilst a consult- 
ant operating a local microscope could perhaps exam- 
's ine a sample and provide a diagnosis in a straightfor- 
ward case in around a minute or perhaps 3 or 4 minutes 
for a more involved diagnosis, whereas even with dy- 
namic telemicroscopy and experienced operators each 
examination can take in the order ol ten minutes or so. 
20 [0006] There is therefore a need for an improved 
method of telemicroscopy. 

[0007] The invention also relates to the area of micro- 
scopy training, and particularly to the area of teaching 
of diagnostic methods employing microscopy. 
25 [0008] At present training in diagnostic microscopy 
performed either by circulating prepared sections on 
glass slides formed by the circulation of electric micro- 
scopy images of a data storage medium such as CD 
ROM. The former of these two approaches is time con- 
so suming and inconvenient, particularly because samples 
get misplaced or damaged in transit. Both methods have 
the further disadvantage that there is both specific mon- 
itoring of whether or not a student performs a diagnosis 
simply by chance or by incorrect methods, meaning that 
55 both are limited teaching tools. 

[0009] In the context of telemicroscopy and indeed 
any form of microscopy where images are displayed on 
a monitor rather than viewed directly by the eye, it is 
perhaps misleading to talk in terms of magnification. If 
40 an image is obtained and displayed full screen on a 17 
inch computer monitor, the magnification will be greater 
than if the same image is displayed full screen on a 15 
inch monitor. The resolution will, however, be the same. 
Accordingly, the term resolution is a better descriptor of 
45 the amount of information given in a particular image 
and relates, in the context of a digital camera, to the 
number of pixels of the CCD device per unit area of field 
of view. 

[0010] According to the present invention, there is 
so provided, in one aspect, a method of telemicroscopy 
comprising the steps of: preparing a specimen on a mi- 
croscopy slide; placing the slide upon the stage of a mi- 
croscope equipped with digital imaging apparatus and 
motorised stage; imaging the specimen to obtain a com- 
ss posite high resolution image of the whole specimen; dig- 
itally obtaining a relatively low resolution copy of that 
image; and storing the images in a datastore; wherein 
the method further comprises the steps of allowing ac- 
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cess to the datastore from a terminal; transferring the 
low resolution image to the terminal and displaying the 
image upon a monitor; selecting by means of the remote 
terminal, as desired, an area of the low resolution image 
and transferring corresponding high resolution image 
data for that area from the datastore to the terminal. 
[0011] The terminal may be a remote terminal. 
[0012] The method may comprise the step of record- 
ing the areas of the low resolution image that are select- 
ed, for review of performance of a person performing 
the method. In a second aspect, the present invention 
provides a telemicroscopy apparatus comprising a mi- 
croscope provided with a digital imaging apparatus and 
a motorised stage which can be controlled to obtain a 
digital image or plurality of such images, at a desired 
high resolution, of an entire specimen placed upon the 
stage; image processing means to obtain a low resolu- 
tion copy of the image of the specimen; storage means 
to store the images obtained; and means for transfer- 
ring, in use, image data to a terminal in response to re^ 
quests therefrom. 

[0013] Preferably, the digital imaging apparatus is a 
digital camera, or else an analogue video camera pro- 
vided with appropriate dig it iser hardware. The appara- 
tus may comprise means for moving the objective lens 
of the microscope in order to provide automatic focuss- 
ing. 

[0014] In a preferred embodiment, a continuous se- 
quence of successive images of the specimen is ob- 
tained by advancing the field of view of the objective lens 
of the microscope stepwise across the specimen and 
acquiring an image of each field of view. The objective 
lens is selected to ensure sufficient resolution in the im- 
ages of the specimen and sufficient images are cap- 
tured and stored to cover the whole area of the speci- 
men on the microscope stage. 

[0015] The apparatus may comprises means for re- 
cording what image data is requested for review of the 
performance of a user. The recording means maybe a 
data storage disk, such as a floppy disk. 
[001 6] With a knowledge of the pixel size and number 
in the imaging apparatus used and the calibrated mag- 
nification of the objective of the microscope, the compu- 
ter moves the stage such that adjacent images are ef- 
fectively continuous in the two dimensional specimen 
plane, and can be thought of as 'tiles' in a very large 
composite 'montage 1 virtual image. 
[001 7] The above and other aspects of the present in- 
vention will now be described in further detail, by way of 
example only, with reference to the accompanying fig- 
ures, in which: 

Figure 1 illustrates schematically an embodiment of 
the apparatus in accordance with the present inven- 
tion; 

Figure 2 is complete navigational map of a sample 
on a microscope slide which has been imaged in 
accordance with an embodiment of the method of 
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the present invention; and 

Figure 3 illustrates in further detail one aspect of the 

embodiment of Figure 1 . 

s [0018] Referring to the Figures, a biopsy sample for 
analysis is taken and mounted upon a microscope slide 
10 in a conventional manner. The specimen slide 10 is 
placed upon a motor driven stage 11 of a microscope 
12 fitted with a camera 13, typically a digital, high reso- 
10 lution CCD camera of diagnostic quality - at least 1024 
x 1024 pixels, 24 bit colour. The stage is adjustable in 
three dimensions with respect to the focal axis of the 
objective. This is typically achieved with a computer 16 
controlled motorised movable stage 11 , but could equal- 
75 |y well, if unconventionally be achieved with a static 
stage and a movable objective. 
[001 9] The objective lens 1 4 is selected according to 
the maximum desired resolution for the task in hand - 
typically 10X, 20X or 40X. The complete specimen is 
20 imaged by capturing an image of a first field (or area of 
the specimen) 20, advancing the stage to an adjacent 
field 21 , capturing an image of that field, indexing to the. 
next field 22 and so on (referred to as scanning). The 
individual field images 20, 21 , 22 etc are stored on disk 
2S as part of a single large file or may be digitally com- 
pressed and stored electronically representing a high 
resolution virtual image of the original slide specimen. 
At the same time, a decimated copy of the very large 
image is created to represent a low resolution navigation 
30 map 30. Typically, the number of pixels in the low reso- 
lution map 30 will be the same as that in each of the 
original images 20, 21, for example 1024 x 1024. The 
total time for acquisition of the collection of high resolu- 
tion images will typically be around 5-20 minutes, de- 
55 pending, of course, upon the specimen area to be 
scanned and the field of view of the objective lens. 
[0020] When scanning with the high power objective, 
a problem is often encountered in that it is difficult to 
drive the motorised stage, such that it is normal to the 
40 optical axis of the microscope. Indeed, microscope 
slides are not perfectly flat. Because of this, the need 
arises to refocus the microscope periodically when 
scanning a specimen. Refocussing adds significantly to 
overall scan time. This can be overcome with the 
*5 present invention by means of a piezo-electric driver, or 
other objective lens moving device, rather than requiring 
the movement of the motorised stage relative to a fixed 
objective lens. 

[0021] This occurs before the consultant becomes in- 
so volved and so maintains a high efficiency in terms of 
consultant time. 

[0022] In practice, based on a knowledge of the pixel 
size and number in the camera and the calibrated mag- 
nification of the objective of the microscope, the dis- 
55 tance by which the stage must move between each im- 
age acquisition is calculated. The stage is moved to the 
co-ordinates of the selected starting point and the first 
image is acquired. The image is compressed and stored 



EP 0 994 433 A1 



3 



5 



EP 0 994 433 A1 



6 



to disk and a low-resolution tile is made from that image. 
With a knowledge of where the tile image originated, the 
tile is "pasted" onto a navigation map matrix and stored. 
The stage is then advanced to the next co-ordinates and 
the next image is acquired. 

[0023] By making use of multi-thread software design, 
it is possible to optimise scan time by arranging for im- 
age compression and storage to run in parallel with 
stage movement and image acquisition. 
[0024] The microscope stage 1 1 and the CCD camera 
1 3 are controlled by appropriate hardware and software 
of the server 1 5, in a generally conventional manner. 
[0025] As is evident from the image shown in Figure 
2, unevenness in specimen illumination may lead to a 
certain degree of shading around the periphery of each 
field image. If desired, the high resolution image can be 
digitally processed to remove this shading. However, it 
is envisaged that consultants will generally prefer to see 
a "raw 0 image for fear of the loss of important detail if 
the image is excessively post-processed. 
[0026] The navigation map 30 and collection of high 
resolution images are stored locally in computer mem- 
ory in a computer or server 1 5. For a typical 20 x 50 mm 
specimen as described in the introduction, such a col- 
lection of high resolution images could be expected, with 
50-100-fold digital compression, to occupy up to around 
1Gb of memory. Typically, a compressed navigation 
map might be expected to occupy around 50Kb of mem- 
ory. 

[0027] At this stage, access to the microscope is no 
longer required and it can be put to use on the next slide. 
Communication may now be made between the local 
server 15 and the consultant at a remote computer 16, 
upon which is mounted the appropriate client software. 
Communication may be via a dedicated link, for exam- 
ple to a centralised expert diagnostic centre, or by any 
other suitable means, such as over the Internet even to 
a consultant's portable computer. The system is not lim- 
ited to one:one connections. The server can be config- 
ured to support simultaneous access by multiple clients. 
[0028] At his client computer 16, the consultant re- 
ceives the low resolution 'navigation map' 30 of the en- 
tire specimen image from which he can access the high 
resolution images. As the compressed navigation map 
is comparatively small, there is only a minimal delay 
whilst the data is transferred. In its simplest form, an 
original high resolution image itself is retrieved simply 
by clicking or otherwise selecting the appropriate area 
in the navigation map 30. In another embodiment, the 
consultant is able to select any specific area of interest 
by 'rubber banding" a rectangular region either on the 
client's navigation map display, or else on the currently 
displayed field of view. The server then extracts the ap- 
propriate high resolution image from a very large com- 
pressed file, then compresses this field-of-interest view 
and sends it to the client computer 16. 
[0029] Typically, the consultant will have two compu- 
ter monitors, the first monitor 35 to continually display 



the navigation map 30 and the second monitor 36 to al- 
low the consultant to display a high resolution image 40 
of an area 41 selected by the consultant by "rubberband- 
ing" a desired area from the map 30 using, for example, 
5 a mouse connected to his terminal. The server 15 will 
immediately access the image store and construct a 
compressed image corresponding to the selected area 
for transmission to the client computer. In the limit of 
magnification, the enlarged image 40 on the second 

10 monitor 36 will typically correspond to the magnification 
used in the scanning procedure, but it could typically be 
digitally enlarged up to around twice the scanned mag- 
nification without loss of apparent image quality. 
[0030] In a further preferred embodiment the remote 

'5 consultant will be able to reconstruct the navigation 
map. If for example, it is clear at first sight that 50% of 
the navigation map 30 shows nothing at all or is not rel- 
evant to the diagnosis, it may be distracting for the con- 
sultant to have it constantly displayed on the first screen 

20 35. Accordingly, the consultant can 'rubberband' the de- 
sired area and the server will construct a new navigation 
map and transmit it to the client computer. Thus the new 
navigation map may be at the same resolution as; the 
original map or at an increased resolution as desired. 

25 [0031] An advantage of the present system is that the 
complex and storage intensive data processing is car- 
ried out by the server 1 5 locally to the microscope, such 
that only that image data called upon by the consultant 
needs to be transmitted to the consultant's computer 1 6. 

30 That data is comparatively small and can thus be trans- 
mitted quickly. The client computer 16 is not required to 
carry out any complex data processing other than de- 
compression and display of the images retrieved from 
the server. In addition, the server can be configured to 

35 allow multiple concurrent accessing of the data, for the 
purposes, for example, of multiple diagnosis or teach- 
ing. 

[0032] In the preferred embodiment illustrated, the 
second monitor 36 also displays small thumbnail imag- 

40 es 45 of areas previously examined in detail as an en- 
larged image 41. These thumbnail images 45 are tem- 
porarily stored locally to facilitate rapid retrieval should 
the consultant so require. Ultimately, the original image 
data corresponding to the thumbnail images, and includ- 

4S jng the navigation map image 30, can be stored centrally 
constituting a part of the patient's medical records and 
also serving as an 5 audit trail recording those areas of 
the slide which were actually examined by the consult- 
ant. The remaining high resolution images on the server 

so can be discarded or backed up as desired. This illus- 
trates a yet further advantage of the present invention. 
It is inherently well adapted for efficient data warehous- 
ing and provides a useful compromise between storing 
the whole data and storing no data. Neither of the exist- 

55 jng dynamic or static telemicroscopy techniques can 
provide such a feature without considerable additional 
modification. 

[0033] Use of the present invention allows the remote 
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consultant access to any area of the slide at will, and 
allows him to control magnification at will. In many ap- 
plications, it is as fast as direct examination of the local 
slide. 

[0034] Having described the use of two screens; it will s 
be immediately apparent that the same result can be 
achieved using separate virtual screens or windows 
within a GUI operating system upon the same monitor 
screen. 

[0035] The apparatus and method of the present in- 10 
vention are particularly well suited to the majority of oc- 
casions where an immediate diagnosis is not required 
and its primary advantage is in the speeding up of non- 
urgent cases. It avoids the need for microscope samples 
to be transferred between hospitals, being advanta- is 
geous both in terms of reducing the delays due to sam- 
ples being in transit and the risks associated with trans- 
ferring possibly dangerous samples. However, the in- 
vention is also potentially suitable for those cases where 
an immediate diagnosis is required, for example when 20 
a frozen section sample has been taken from a patient 
during an exploratory operation. This feature will be par- 
ticularly advantageous in highly specialised areas of 
medicine in which there may be only a few suitably ex- 
perienced clinicians who may well be in other parts of 25 
the world when a diagnosis is required. 
[0036] In summary, the present invention overcomes- 
the stated limitations of static telemicroscopy without the 
high cost entailed in dynamic telemicroscopy. Cost sav- 
ing is primarily through reduction of consultant time. This 
is essential to realise the potential benefits to quality of 
diagnosis in routine telepathology etc. Furthermore, the 
scanning process can easily be adapted to unattended 
hatch processing, in which, not just one slide but a col- 
lection of slides is scanned sequentially. 35 
[0037] The simplicity of providing multiple access to 
the server makes the invention ideal for teaching pur- 
poses, as well as for professional quality assurance as- 
sessment. 

[0038] The concepts described above can be applied 40 
as a teaching apparatus and for professional quality as- 
surance by providing the apparatus with a return path 
in which the apparatus returns information about the 
fields of view selected by the operator. The apparatus 
may also provide means for enabling annotation to be 45 
inserted by a user to provide total feedback of the user's 
approach to a monitoring teacher. 
[0039] With such an arrangement it is not necessary 
to return actual images, but simply to return the bounds 
information on the boundaries of the field within the so 
frame of reference of the large-scale virtual image. This 
is because the teacher has access to an exact copy and 
reconstruction can be performed at the teacher's server. 
In this way, an entire diagnostic session can be returned 
in a file which can be easily transmitted by E-mail or on 
a floppy disk, for example. 

[0040] Whilst, as with the above example, the image 
provider (teacher) and the image reviewer (the student) 



can be at either end of a local area network or other 
telecommunications, other possibilities are available. 
For example an appropriate data storage device, such 
as a CD-ROM could incorporate all of the image data 
and when loaded into an appropriately configured PC 
can emulate a remotely accessed system. 



Claims 

1. A method of telemicroscopy comprising the steps 
of: preparing a specimen on a microscopy slide; 
placing the slide upon the stage of a microscope 
equipped with digital imaging apparatus and motor- 
ised stage; imaging the specimen to obtain a com- 
posite high resolution image of the whole specimen; 
digitally obtaining a relatively low resolution copy of 
that image; and storing the images in a datastore: 
wherein the method further comprises the steps qf . 
allowing access to the datastore from a terminal; 
transferring the low resolution image to the terminal 
and displaying the image upon a monitor; selecting 
by means of the remote terminal, as desired, an ar- v 
ea of the low resolution image and transferring cor- . 
responding high resolution image data for that area 
from the datastore to the terminal. 

2. A method according to cla im 1, where in the terminal 
is a remote terminal. 

3. A method according to claim 1 or claim 2, further 
comprising the step of recording the areas of the 
low resolution image that are selected, for review of 
performance of a person performing the method. 

4. A method according to claim 1 , 2 or 3, wherein a 
continuous sequence of successive images of the 
specimen is obtained by advancing the field of view 
of the objective lens of the microscope stepwise 
across the specimen and acquiring an image of 
each field of view. 

5. A telemicroscopy apparatus comprising a micro- 
scope provided with a digital imaging apparatus and 
a motorised stage which can be controlled to obtain 
a digital image or plurality of such images, at a de- 
sired high resolution, of an entire specimen placed 
upon the stage; image processing means to obtain 
a low resolution copy of the image of the specimen; 
storage means to store the images obtained; and 
means for transferring, in use, image data to a ter- 
minal in response to requests therefrom. 

6. An apparatus according to claim 5, wherein the dig- 
ital imaging apparatus is a digital camera. 

7. An apparatus according to claim 5 or claim 6, com- 
prising means for moving the objective lens of the 
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microscope in order to provide automatic focussing. 

8. An apparatus according to claim 5, 6 or 7 compris- 
ing means for recording what image data is request- 
ed for review of the performance of a user. s 

9. An apparatus according to claim 8, wherein the re- 
cording means is a data storage disk, such as a flop- 
py disk. 
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